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AN INITIAL ATTEMPT TO EVALUATE PROGRAMED INSTRUCTIONAL 
MATERIAL IN ALGEBRA CLASSES LED TO FURTHER EXPERIMENTATION 
WITH A VARIETY OF PROCEDURES. IN 1964-65, NO SIGNIFICANT 
DIFFERENCES WERE FOUND IN THE PERCENT OF STUDENTS SUCCEEDING 
IN PROGRAMED AND CONVENTIONAL CLASSES, THOUGH STUDENTS IN 
PROGRAMED SECTIONS BID NOT SEEM MOTIVATED TO WORK AT THEIR 
OWN PACE TO COMPLETION OF THE COURSE. IN TEE NEXT YEAR, USE 
OF LARGE CLASSES FOR PROGRAMED INSTRUCTION, WITH NO CHANGE IN 
AVAILABLE TEACHER TIME, SHOWED NO SIGNIFICANT DIFFERENCES IN 
THE PERCENT OF SUCCESSEi>, WITH GREATER MOTIVATION IN THE 
LARGE GROUPS, AND WITH MORE EFFECTIVE INSTRUCTION WHEN A 
VARIETY OF INSTRUCTIONAL EXPERIENCES WAS USED. DURING THE 
NEXT TWO YEARS, WITH LARGE GROUPS FOR PROGRAMED INSTRUCTION, 

A REDUCTION IN TEACHER TIME, AND AN INCREASE IN CLERICAL 
ASSISTANCE, CD NO SIGNIFICANT CHANGES IN ACHIEVEMENT 
RESULTED, (2) A UNIFORM TESTING, EVALUATION, AND GRADING 
PROGRAM WAS ESTABLISHED, (3) A COMPLETE ITEM ANALYSIS WAS 

POR EACH TEST, AND (4) THE- PROGRAM WAS SYSTEMATIZED TO A 
POINT WHERE INSTRUCTOR TIME COULD BE FURTHER REDUCED AND EVEN 
LARGER NUMBERS OF STUDENTS COULD BE ACCOMMODATED. (WO) 
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h Report: on Esperiaaenta^ion la the Teaching of 
The First Course in AXgehra at B1 Canino CoXXege 



Introduction 

This is a report of essperiaaentation in taacshing reniedlaX 
siiathet^tics.o l^iXe it started as a rather siHpXe project 
designed to e'^aXuate prograsuised instructionaX ssateriaX# it 
has ©regressed tl^cugh 'esspersiaentation with large cXass instruc* 
tion^ team teachisig, and the de'^eXopment of machine-scored 
HuXtioXe choice esraminations with coii^lete item analysis* 
is thus not a single^ isolated research project hut a continuing 
effort hy a group of t-sn to fifteen instructors directed tcjward 
the isaorove^snt csif ■ instruction* effort has and will con— \ 

tiaue to esaBsine many. facets of the education process? ie* course 
objectives {r student characteristics# teaching laetlnods# course 
standards, testing methods and procedures, and gradiiig practices* 

Bach teacher or team of teachers has operated in a scHaowhat 
uniou© manner, reported successful# unsuccessful aiid inter.esting 
rc^sults as well as suggest many directions for future elisperiniesi— 

tation* 



teong the ideas for the future ares 

Xo Presentation of the course via dosed— circuit or 
open-circuit television 

2 . To try to establish the ©ssistence of a relation 
n 

y “ I 
1 « 1 
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where the sl^ are constants and at least on© is apt 
zero# the are student or course diaracteristics, 
and y is the student®s grade. Of course it is 
iffi^llcit that values of th© parameters need to ho 
determined. This is an application of the method 
of least scares or smalt ipl© curvilinear regression 
and factor analysis. 



Po attempt to determine if some students are uj^du- 
sable Sin mathematics) at this level* lihile this 
Ls basically an unsolvable problem# the directrw 
af seas© thmght in this directi<m vss^ hav© valu^le 

consegu^ces. 

^ile it would he dasirable to include m^h addi- 
tiojial information on such iteis^ as 
for ^Bseriasentation and rese^ch# it is felt 
it is a^© dasirsibl® at this tism to give a stata- 

sent of th© 
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ThB problem is essentially a simple but auajor problem in 
remedial courses at all Junior colleges with an open-^door 
policy* be specific ^ a stu(^ of the grades of the students 
enro3.1ed in the First Course in Algebra (%diich call 
Mathematics A> over a five year period Csbout 3000 students) 
revealed that cpproKiiaately 50% of the students witl^iSrew 
before the end of the semester® Of those remaining* approjsi*- 
mately 50% pass with a C or better grade Cio©<» 25% of the 
students originally enrolled) ® Also, enrollment trends indi- 
cated that within a very short time this ccsurse could require 
2x€m 40 «» 50 % of the ^btal staff time assigned to math^atics 
instructi^m® ^l?!ms a large percent^e of the load of a highly 
qualified staff was being used at 25% effieieni!^® !Ehe purpose 
of study was therefor® two-fold? (1) the isj^rovemeat of 
instruction Cor learning), and/or (2) effective use of instruc- 
tor tiise® 



^oafcif ication or Heed for_the^„StM^ 

lo ^he lew percentage of student success in the course 



It was stated in the previous section that approxi- 
mately 25% of tlie students originally ©lEurollcd achieve 
a "C** or better grade® ThQ actual figures ares 



Percent of original students achieving an 
A or 3 grade was 13*1% 

Percent of original students aciiieving an 
A, 3, or C grade was 30.6% 

Percent of original students achieving an 
Af B, C or B grad© was 46*4% 



It should also ba maationed that ualihe asany similar 
courses in other junior colleges, this course has no 
prerequisites, ^’his may account for differences in per- 
centages which may exist other junior colleges. 



A reasonable criteria on which to evaluate this 
nroblem Is that any student who is permitted to enroll 
in a course should have at least a 50% chance of success < 
However, regardless of the criteria any Improvement in 
the percentages will result in significaat savings in 
student tii&e and educational expenses* 

2® 5Phe inprovement of instruction Cl©S3fBiag) 



TOis is certainly an dbjisetive of any eaqperimento- 
tiOB in instruction® ThB achievement by a student of a 
”C** or better grade is defined to be the measure of 
instruction.- Xnplicit in this of course is the state- 
ment of course objectives m measurable terms. 
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3u 75»90% oJ^ the strides^ts enrolled In the course 

had taken an equivalent course before and had either 
not succeeded or had forgotten much of what they knew. 

Xt was felt that perhaps a different approach might 
provide more motivation and a greater percentage of 
successful students. 

4o small penalty for the failure of experimentation at 

this level 

Miile the significance of the possible results may 
warrant experisaentation where the chances of success are 
small or where the penalties for failure are high, serious 
consideration should always be given to t:he impact of fail*^ 
ure. If there is a choice, experimentation should be con^ 
ducted where the penalties for failure are minimal. 

So To develop a philosophy on our obligation to students at 
this level under the open«door policy 

Of the students who typically enroll in this course, 
75-90% have had the same or an equivalent course at least 
once before. Since large numbers of students are involved 
it is expensive to allow each student several chances. 

Po v?e adopt the position that each student should be 
entitled to one (or some other mmiberl opportunity to 
pass the course or do we adopt the position that an unedu- 
cated person may soon be uneie^loy^le ^Ln our scientific 
society and tlierefore we not only provide the opportunity 
for learning but noast be responsible for learning? 

6« To f^Lnd hcF^ to teach large niambers of students at this 
level 

•Shis course constitutes approximately 30% of the 
total assignment in the Matliematics Department and in- 
volves about 2000 students csach year. We need to be 
concerned about Ihe effectiveness and efficiency of in- 
struction. 

7* To find how to relieve a highly qualified staff from too 
much involvement at a remedial level and to more efflci* 
ently use their capabilities. 

8. To investigate the appropriateness of programmed materials 
for remedial mathematics courses in 1:he junior college. 

9o To investigate the effects of variations in class size on 
the effectiveness of instruction. 

10 o To investigate the effects of team teaching on the effec- 

tiveness of instruction. 

11 o To investigate the application of a systems approadi to 

the teadhing of junior college mathematics. 




TiHpftyfeanea oS the Problem 

Zn addi1;ioii to the Itejas saientioned in tlie previous section, 
there have already been se'^mral results of importance to El 
Camino College. First it has been beneficial to the entire 
staff and staff morale in permitting a much larger percentage 
of time to be devoted to more personally rewarding instruction 
^ 1 ^^ <r> the cshallenge associated with ejsperisuentation* ®^e 
staff attitude and’ particularly the effort and enthiasiam dis- 
played by the instructors involved in the project has been most 
rewarding* Another result has been the development of a uniform 
testing procedure and the consequent uniformity of course stan- 
dards and gradinsf practices. We thus guarantee each student 
that regardless of the section in which he enrolls, he will 
receive the same grade that he would have received if he had 
enrolled in any other section* ^is result, incidentally, haa 
provided some insight into tiie relation between the time at 
which a class meets and the siiccess of the student* 



While not one of the objectives of^h'^ study, on® of the im- 
portant results has been a significant reduction in per 
student cost for instruction in this course* Upon the recceo^n- 
dation of the teachers, equivalent of two full time teachers 
was replaced with 40 hours per weeh of student help* Tae savings 
could have been larger except for space limitations of our present 
facilities* staff has reccmnnended further reductions, but we 

have deferred action on this. The present savings are at least 
$30,000 per year* 

Perhaps more important than these local benefits is the fact 
that this problem td only one case of a general problem coMon 
to other mathematics courses, other subject «areas and other 
colleges. The same results could be attained in most other fields 

if it was desired. 



Criteria or Philosophy 

This section of the report is quite lengthy and includes 
statements on many subjeeta« Sn addition to scxse 
statements on operating philosophy and procedures, it jjicludes 
some objectives and criteria of programmed instruction and educa- 
tional systems as well as same comments on the growing cSemands 
to educate mere students at a reasonable cost* 



Our operating philosophy and procedures can be suromarized 
by the follc^?ings 

Ic If you have a problem and don®t know how or in what 
direction to proceed, don®t just ©it there, do 
something^' This usual advise for students is also 
valid for educational problems. 



2o purpose of research is not the , collection of 

data but to provide insight into the problem and 
its possible solution or to suggest directions for 

furthe;r research* 

Educational research is, lilce any research, an 
effort to acquire kno'i<?ledge and to enlarge under- 
standing* 
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It is hoped that the results of researdi will be 
capable of generalissation and applicable to other 
areas or useful for prediction or esstrapolvation* 

5» The place to eatperiment is the place when there is 
the least penalty for failiire. 

S, While some may feel that it is best to design an 
estperiJBient witSi the assumption of a hypothesis and 
the use of one or more of the usual models for 
ei^^cperixaental design ^ rigid adherence to a format 
should not interfere with escperimentation. One of 
the best methods to stifle instructor creativity is 
to aslf. tliem to write a description of their proposal 
or to esiperiment in a masmer basically different 
from the one they propose* Faculty enthusiasa is a 
necessary ingredient and its value will outweigh 
many factors* 

7. W® in science education can no longer assume that 
the ejstent of our responsibility for learning is to 
provide the opportmiity for an education* 2Cn our 
increasingly technological and scientific society, 
an uneducated person may soon be unemployable* We 
must assume a greater responsibility for both the 
opportunity to learn and that learning does occur* 

Without defining educational programming or programmed learn- 
ing, the following will list some of the objectives of linear 
CSkinnerl# branching (Crowder), or eclectic prograimftlng • It is 
assumed that most will be aware of studies verifying the claims, 
therefore some negative arguments will be presented here* They 
come largely from "Programed Learning and Mathematical Education" 
by K.O* May and "Systems Jlpproadhes to Curriculum and Instruction 
isi the Open-Door College" by B« Laxiiar tfchnson* 

One essential fact has been established 
without a doubt: Students do learn from 

programed materials* On id\© other hand, 
there is no conclusive evidence that stu- 
dents learn significantly more or with 
greater efficiency* •*« 

(a) Do programed materials perform a 

tutorial function? ••* programed 
materials lach the essential fea- 
ture of the tutoring situation 
the interaction of two human beings 
i n all its intellectual and emo- 
tional coix^leacity. •*• We concliide 
that programed materials do not 
perform the tutorial function, though 
they may perform the drill sometimes 
done in the name of tutoring* 



(b) Do programed materials provide for 
individual differences? The 

fact is that Skinner prograjaing 
removes all individualization 
e^^cept in pacing* Crowder pro- 
graming has a better claim to 
individualization because of 
branching, but the variety of 
paths is rather limited cojffpared 
with that permitted by the usual 
tesst booko W© conclude that 

programed materials (Skinner, 

Crowder, eclectic) ar© less 
adaptable to individual differen- 
ces than are hybrid, problem, and 
Pressey prograiris* 

men stressing tlie importance of 
self-pacing, programing enthusiasts 
seem to be contrasting the indivi- 
dual studying a program wit:h the 
group listenii-ig to a lecture or 
studying together* A ccutiparison 
with an individual studying a teast 
and doing problems tfould be more 
appropriate* ♦♦•As long as the 
group pace is not too far from the 
average, learning is not signifi*^ 
cantly impeded* *•» It appears 
that pacing is not a very important 
issue and that self-pacing has no 
necessary or migue vcoianection with 
programed materials* ••• 

Does orcgraJfting provide greater con- 
trol of the learning process? This 
claim is certainly justified* 

This has obvious advantages for 
research in the psychology of learn- 
ing. It enables the programer to 
locate poor frames and to improve 
the program* It likewise, helps the 
diagnostic work of -fehe teacher. 

But it does not follow that it is 
best for the student. One of 

tlie goals of college mathematics is 
to teadh the student to "work on his 
own“— to "write his own program" in 
the professional jargon. He will 
certaixily not learn to do this if he 
is fed ideas intravenously drop by 
drop instead of having to get out 
and grub for th®ti. • * ^ We conclude 
that programed materials inhibit 
initiative, independence, and respon- 
sibility in the learning process, and 
do not contribute to the achievement 
of related educational objectifies. 



Do prograined materials provide 
greater motivation? o«o Es.peri~ 
ence at the college level tells 
us that students have t»o prime 
drives in studying mathematics : 
their belief that mathematics 
will be useful to them, and the 
Joy tha\t comes from mathematical 
insight and accomplishment* 

Vfe infer that programed materials 
cannot provide adequate/ motivation 
at the college levels 

Does programing lead to better 
specification of content and objec- 
tives? • •• The potential of pro- 
graming for improving content has 
not been reali.^ed» 

hre programed materials better 
designed to achieve their objec- 
tives? • •o ^are is no convincing 
evidence that better design is a 
concomitant of programed materials* 

^Ibat i^ the importance of overt 
response? Pressey •*« condensed 

a Skinner type program in psychology 
into an es^ository passage followed 
by a few multiple choice questions* 
*^e result was better learning and 
an 80 ^ saving in study time (and 
paper U » One of the great dis- 
advantages of excessive programing 
is that it enables the student to 
"succeed** without extensive or 
intensive thought* •** 

Does programing reduce educational 
costa? In certain situations in 
industry and the military, where 
teachers are lacking and goals 
narrowly defined, programed mate^ 
rials and teaching machines have 
acconplished tasks not otherwise 
possible* But in the typical col- 
lege situation there is no indica- 
tion that programed learning is 
more econcmical* 
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(J) Do programed materials save tea- 
Cher time? <,<»• There is no reason 
to ^ink tihat programed materials 
will displace teachers* As supple- 
ments to text books they may* hot#- 
ever* bring about shifts in the 
teacher ^8 role by taking over yome 
routine drill* ••• (7 ) 



Xn 1958* started a project to 



explore progzaiEBd- instruct ion tech- 
nology* Xt appeared that existing 
programs provided for individual 
differences in rate of learning but 
did not provide for differences in 
the level of component skills of 
students during the course of instruc- 
tion* A ccmiputer-based teaching mach- 
ine was developed to provide for such 
individual differences « S>tudents 
doing well would skip instructional 
segments while those having diffi- 
cul*^ on a particular concept would 
be branched to remedial segments 



necessary to successful performance 
on the concept* Bs^rience with 
this machine quickly revealed that 
its effect on learning depended 
mostly on the effectiveness of the 
instructional materials used by the 
madhine* One study effort* in an 
atteiof^t to design improved instruc- 
ticmal materials* surveyed the re- 
search literature on learning and 
made a series of experio^ntal com- 
parisons* The most notable result 
of the formal hypothesis-testing 
activities was that no statistically 
significant differences emong experi- 
mental treatments w»re obtained* 
Different sequencing psr^cedures* 
cueing techniques ^ response modes* 
display formats* and reinforcement 
procedures had but limited effect* 
Variables suggested by different 
learning theories were manipulated 
but again with little practical im- 
pact on student learning* The for- 
mal hypothesis testing and the ^ 
literature search were abondoned and 
popular* new* conoaercially produced* 
progra3Bimed instructional material 
was tried* Considerable pviblicity 
bad been given this material as the 
latest in modem instructional 

technology* Xt^also lulled to pro- 
duce its ^vertisea objectives* 




Finally a proceduira was tried that 
did succeed » ^is consisted of a 
careful specification of learning 
objectives in behavioral and meas* 
urable fona, followed by a eucces* 
sion of evaiuation*»revision cycles* 

Each defect in the instructional 
material was detected, the behavi- 
oral ccnoononts involved %fere 
reanalysed, and specific changes 
were made in the defective segment * 
Ideas for possible changes viere 
obtained from interx’^iews and indi- 
vidual tutorial session© with stu?» 
dents * Repeated evaluation-revision 
cycles were conducted until new stu- 
dents ©asposed to the materials con- 
sistently achieved tJhe desired 
objectives* ^hus the developing 
Dachage of materials was continually 
iK^roved in th=3 direction of a given 
set of ^solute objectives* 

Ifhis technique is different 

from a cne—tsme eva lua t ive comparison 
of the first version of the new package 
with so-called ”coh^ntional** proce- 
dures {“conventional** is that used by 
the other school) ’Sh© evaluation— 
rovision cycle is more like the 
engineering process where the 
developaent activity is followed 
through t© the final stage of i!J®>le- 
mentation, and is much more costly 
in tiwse and effort than the one-shot 
comparative stu^. However, t^e 
engineering approach, uhich begins 
with system objectives and uses self— 
corxrecticn procedures, culminates in 
workable tools and procedures that 
are guaranteed to do cesrtaia speci- 
fied things for the instructor, while 
the traditiosial coa^arative-assessment 
study seldom goes further than a 
research report having little impact 
on a classroom practice* ^he engin- 
eering approach implies a cosialtment 
to m^e a new product or procedure 
work, rather than merely making a 
single evaluation for the puacpose of 
deciding whether or not to adqpt it 
almost all new developments fail on 
the first try« 
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Xt has been pointed out that the educa~ 
tional system requires for its operation 
at least the follonring different actions: 

(a) selecting the learners, (b) choosii^ 
the Objectives, (c) designing a program 
of learning experiences, (d) executing 
the plan, (e) assessing results, and 
(f) con^aring the accomplishments with 
the objectives for purposes of further 
optimisation of the system* Furthermore, 
item ^c) , the devising of a plan or 
strategy, mi^t be shown to requires (a) 
determining the characteristics of the 
learners, (b) mastering the relevant 
scientific knowledge, Cc) identifying 
the available resources, and (d) account* 
ting for applicable boundary conditions. 

... (5 ) 

Ferhaps the most important reason for a philosophy of com~ 
mitment to experimentation is contained , in the statement 

It is becoming clear that the junior 
college will be called upon to assume 
sharply increasing responsibility as 
enrollments in higher education sky<* 
rocket during the years immediately 
ahead. Juiilbr college enrollments 
now approach one and a quarter million 
and are expected to double, or even 
treble, within the next decade. This 
esqpansion will inevitably be accom- 
panied by a demand for greater effi*' 
ciency in all aspects of operations vjp—* 
an efficiency that will make it possible 
for junior colleges to offer high-quality 
instruction to unprecedented numbers of 
students at a cost commensurate with 
that which society is able and willing 
to pay. Taaqpayers and private donors 
to higher education can be expected to 
insist upon getting the highest possible 
value for every dollar spent on colleges 
and universities. ... 

Society will not wait for any institution 
reluctant to change. ••• 

Xn recent educational history there are 
clear warnings that when tShie problems 
of education are not solved within the 
system they are appealed to the public 
arena. When this happens the decision 
is ultimately in favor of the majority. 

Xn other words, **lf the educators will 
not change education, the politician 
will." e.. (6) 



Persistent use o£ evaluation* 
revision cycle will eventually 
produce high~quali'^ sel£*instruc* 
tional materials tliat can be used 
to provide individualised instruc- 
tion » (6 ) 

The albove quotation provides a good transition from program- 
med instruction to the systems approacdi. 

The foilwing excellent comments are from Effective Teaming 
and the Bducaticnal System by Harold Foeeke in the October 1967 
issue of the **jqui^al of Engineering Education* ** 

To begin by offering a definition, an 
educational system is a self-correcting 
activity in which a deliberate attempt 
is made to establish the conditions 
which seem most suitable, in the light 
of the relevant factors, for assisting 
one or more learners in achieving desired 
learning objectives • • • • 

lisarners differ widely in intellectual 
ability, maturity, motivation, age, sex, 
emotional health and stability, physical 
health and/or handicaps, vulnerability 
to **outside demands’* (job, family, etc.},., 
previous edzicational es<perience, previous 
work es^rience, etc. Considering the 
apparent disregard which some educators 
manifest for the individual differences 
among learners^ it is worth pointing out 
that an educational system could hardly 
be expected to function optimally with- 
out a thorough knowledge of the character- 
istics of the learners* Just because 
educators do not fully understand all of the 
consequences of uhe observable differences 
among students does not mean that they can 
be ignored* • • « 

It seems reasonable that any "theory of learn- 
ing" must provide distinctions between funda- 
mentally different kinds of things l^at can 
be learned, things which in lay language 
might be described as concepts, principles, 
skills (motor, mental, etc*), facts* attitudes, 
etc » * • • 
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Descrlptloii 

For reasons listed earlier under justification, the escperi- 
n^ntation began in a discussion in a departinent meeting during 
the spring of 1964. While they recognized that there was a 
problesi, most of the staff of twenty did not vjant to participate 
in ai^ study involving the teaching of this course* B6wever« 
they did agree that if several wanted to experiment they should 
be allowed to do so* ^us our first attempts in the fall and 
spring of 1964«*5 were to try programmed* instruction in the normal 
ciassroom situation with four teachers involved in the experiment* 

Mf 

A study of the methods and results for 1964-*5 and part of 
1963«-6 is Gcntained in An Investigation of the Achievement of 
Students in Mathematlas Classes Using Procrraigmed Materials at 
B1 Camino College ^ a report by Sam Schaiierman for a similar PCXaA 
seminar* !^he mater ihl contained in that report will not be 
duplicated here* 

The results for 1964^5 weres (1) There was no significant 
difference between the percentage of students who succeeded in 
the programmed sections and those In the conventional sections 
even though the tests used in the prograjimed sections were saae«» 
what more difficult* Consideration was given to the idea of 
developing 02 saminatlons \diich could be given to both the e3^rl«* 
mental and control sections* This was not done as the control 
sections were basically traditional mathematics and the experi** 
mental sections ^?ere modern mathematics* The programmed material 
used Was that prep^ed by the School Mathematics Study Group 
(SMSG) and the results of their extensive research was available 
to us* (2) the students did not have enough 8elf«>x»otivatlpn ta 
proceed at their own pace and complete the work successfully* " 

Experiments during 1965-6 involved puttissg half of the total 
students enrolled in the course into sections of 120 students 
eadh, using the same programmed materials, and with an allotment 
of teacher time equal to -what there would have been if the classes 
were all of the usual size (35) * Our results weres (1) There was 
no significant difference between the success of these students 
and the others# (2) the students were better motivated in the 
larger sections than in the small sections which had used program- 
med texts# and (3) the use of a variety of ^instructional es^eri- 
ences was more successful than a single laboratory situation with 
the student using the programmed text* 

During 1966-7 and 1967-3 all students in the course {approxi- 
mately 1000 each semester^ have been placed in classes of^ 100-120 
with an instructor ssslgns^tof someiidiat more than half of what 
it was before* This was upon the recommendation of the teaching 
staff* They are also given 40 hours per week of clerical staff 
time* The results weres {1} There was no significant difference 
between the success of these students and the others# {2) 150 
errors have been found in the programmed text, {3) a uniform ' 
testing# evaluation# and grading program has been esthblishedi 
(4) a complete itei^ analysis is made for each test# and {5) the 
program has been systematised to the place where the instructor 
time could be drastically reduced and thousands of students 






could be handled with very little extra effort* At this stage, 
the progranonied text is an incidental and not an essential part 
of the program* 

«Po pjjQ^jLde a little more insight into the problem and our 
esiperiiiientation a mesaoranduiia is attached* 



Directions for the Future 

After a start «diich was a very ssoall attempt to do some- 
thing ^out a persistent problem, at this stage Idiere seem to 
be two distinct directions whiosh might be tahen in the future* 
Attempts have been made to start in both directions* 

The first is described somewhat in the attached memorandum 
and its attachment. Xt involves open-circuit television. TWp 
statements define the feasibility of this approach* 

1. Xf open-circuit television is going to be econcmi- 
cally feasible as an instructional media, courses 
which are required by very large numbers of stu- 
dents should be presented. 

2. Our method of teaching the First Course in Algebra 
has been systematised to the extent tliat, except 
for space limitations, thousands of students could 
be handled with very little extra effort or cost. 



^lle scsaa attempts have been made to start an inter-district 
feasibility study, some administrators in tSie southern California 
area feel that the first adventrres of the junior colleges in«-o 
open-circuit television should be with college level courses ana 
not remedial instruction. This project has, therefore, tesnpor- 
arily stopped* 



The second direction for the future is in the use of systems 
methods. As noted in an earlier section ”The engineering approach 
implies a coimitment to mahe a product or procedure 
rather than making a single evaluation for the pu^ose of deciding 
whether or not to adopt it almost all new developments fail 

on the first try.” 



Since an educational system could hardly be expected to 
Suactioa optimally without a thorough 

istics of the leaji'ners, following resear<^h ps.oposaj. i*a espec 
ted to give scaae insight into this area. 
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Subjects Teaching Matheioatics A 



Dates Hoveintber X&, 1965 



Tos All Matheioatics Instructors 



X^’rosas Henry l^ns£ield« Jr 



X viDuld like to devote the next departnient meeting to a discussion o£ 
what we should do about the teaching o£ Mathematics A. 

The following is somewhat of a progress report and some of my opinions 
of the problem and what should be done. X hope they will provide some 
background for discussion* 

Xf you have ideas which you would like to present to the group for con~ 
sideratlon prior to the ineetlng, please let me know* 

Background Information 

1* Student Success 

Over the past five year period^ approximately 50^ (coi^parison of 
first and last class counts) of She Mathematics A students have 
withdrawn before the end of the semester* Of those remaining* 

50% pass with a C or better grade* For the regular (35) size 
classes using programmed instruction last year* there was a some* 
what higher retention and* including those xdio continued and 
finished the course in the second semester* the two semester per- 
centage of passing students was the same using either method* 

2. Student Characteristics 

For the Spring Semester of 1964-65 and the Fall Seo^ster 1965-66* 
we have the following informations 



Approxiroately are from Business* Soc* Sci* and undecided fields* 
Approdciraately 60% are enrolled in 9 or more units* 

Approximately 70% work 21 or more hours/week * 



Percentage bv Declared Major 



Total Ho* of 




Undecided 
or no t 



Year Responding Math.Snar* Hat.ScjLA, Soc*Sci* Indicated Oijfeer 
S®65 413 9.9% 10.7% 6.3% 25.9% 12*8% 26*2% 8.2% 
F®65 885 10.2% 16.3% 6.4% 22«0% 9.5% 32.5% 3*1% 



% 



<fSS 



2 «» 



Enrollment Data 

For tlie past several years all of the sect5.ons of Mathematics A 
opened during registration were closed wltli a minimwm of 38 
students par section* ntmOjer of sections offered was limited 

so that th© ultimate need for this course was not IcnowBo This 
fall an attempt was made to determine this need by keeping 
several sections open at all times during registration* However, 
after increasing the number of sections from 18 (the usual nuiaber 
for fall) to 27 and the enrollment from approKimateiy 600 to over 
900 with all sections still closed, the enrolliaent was restricted 
and the ultimate need has still not been determined o 

4. Future Heeds 

For the future, if w© ar© to provide for the nee 3s of students 
at this level, we should have at least 30 sections for the fall 
of 1966, with 40 sectloHS being perhaps a more realistic estimate* 
The staff involvement would be the equivalent of from 8 to 11 
full time instructors or somewhere from 40 to 5056 of the total 
staff tijne in mathexoatics * 



Heed for the Stu<^ 



1* The low efficiency of student success 

2* The iK^rovement of insticuction Cl©^*iing) If possible 

3* The low penalty for failure of eajperimentation at this levol 

4. To develop a philosophy on our obligations to students at this 
level under the “open-door" policy, 

5 a, How to teach large nuxtibers of students at level 

6, How to relieve a highly qualified staff from too mudh Involvement 
at a remedial level and to make better use of their capabilities 



gurpp^^and^ 

The improvement of instruction and the effective use of instructor 
time should be the prime objective's of any of this nature. 

With regular sized classes last year, there was no significant differ- 
ence between the programmed and traditional sections ©f Mathematics Aa 

In reviewing last years methods we have the following observations: 

lo The students were given too much freedom, They were not self- 
reliant enough to be alloi5?ed to proceed at their own rate* More 
stringent requirements are be^hig used this year (attaeshment 1| o 

2, The examinations in the prograsmned sections were too difficult 
last year. We were expecting higher levels of achievement than 
in the regular sections, Tliis has been changed this year. 



o 
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Tbis yaar with tS^e two large sections (120 students in each)* stricter 
requirements for student work and attendance, easier machine scored 
examinations and a more esq^rlenced staff, ttiere has heen less of a 
drpp><^ut and indications that more students will pass* 

Recomiaendation 

We would recommend that 

lo insofar as possible (the availability of large rooms being a 11ml* 
tationl Mathematics A foe taught in large sections (120*150 students) 

2* two Instructors foe assigned 2 sections togeidier wit^ 8 units of 
load each, (roughly half the staff involvement as with small 
sections) 

3. adequate clerical help foe provided (A recomendation on this will 
foe made by Mrs. Bodaan, Hr. Ivens, and Mr. Schwarts) 

4. Assignments should probably foe made on a rotational basis with one 
experienced and one new instructor for eac^ 2 sections, unless 
there are some who prefer to have these sections. 

If it were possible to teach all of Math«Hiatics A this way, 4 day 
sectio»ns and 4 night sections should be sufficient. ‘2!he assigned 
teacher time would be approximately 4 and apprcncimately half of 
that normally assigned. 

Implications for the Staff 

1. The use of prograianasd instructional material is not very challen- 
ging or rewarding from a teaching standpoint, however, it is 
prch^ly not any worse than teaching the large number of sections 
which would be required the other way (each instructor with half 
a load in Mathematics * 

2. X am sure there is seme concern within the department as well as 
school-wide as to whether this will set a precedence for large 
slse classes in other courses. X don' t believe that any changes 
in the est^lished instructional pattern should, or would, be 
made without adequate stu%. Within the division we have made 
two studies of this nature, both of which happened to lead to 
larger class sixes. Qne^ Engineering 11, Engineering orientation, 
in the fall semester, was for the cesnvenience of instructors in 
allowing them to give one lecture instead of having to repeat it 

4 or 3 times during a week. Xt also made it more convenient for 
the instructors to secure eminent guest lecturers. X believe this 
arrangement has the coxj^lete approval of the Engineering staff. 

With the two*fold objective of the study in Mathematics A, 

1. i^rovement of instruction (as measured 3:^ the percentage 
of students passing) and 

2. relief from the increasing nuniaaers of students at a bas- 
ically remedial level? we have not had too> much success 
with the f irst but have a method where the results are at 
least as good and the staff obligations are about half as 
much. 



3* AXthough teaciher load has not been specifically loentloned* 

It is implicit in the recommendations that a section of 
120, with adequate student help, is equivalent to a section 
of 35 taught in the traditional manner • llhis is based on 
the recocanendatioiis of Mrs* Bodmsn, Mr» Xvens, and Mr* SchwaaEtz* 

Other Alternatives 

It has been suvggeated that another possible solution to this problem 
would be to not offer Mathematics A {and perhaps Mathematics B) at 
£1 Camino and to ask that they be taught in the Adult Education pro- 
grams of our affiliated high school districts {it has been reported 
that they would be willing to do this under any conditions we would 
desire to impose) » 

I personally do not 13ke this solution for the following reasons* 

1„ At the present time. Adult Educeiion programs are not accredited 
{there are indicat:ions that this may be done within the next few 
yearsK Students enrolled in such courses, applying for admission 
to the University of California, certain state colleges and private 
schools, may find the credit not acceptable « Although we could 
coc^erate in setting standards and verify the ^equivalence of these 
courses with our present courses, we would, :Ln essence, be acting 
as an accreditation agency* !!I!'his is not a function of the Junior 
college and might lead us into an untenable position with relation 
to the high schools* 

2* Historically, and under the Master Plan for Higher Education in 
California, t3ie teaching of these courses is propi^rly the function 
of the Junior college and no other segment* We should provide 
program, but the nature and extent of our obligations needs 
to be examined. 

3. If we delegate this responsibility to the adult aschools, I feel 
we would Just increase oi'ir problems at the Mathematics D, 25A 
level* We would not eliminate our problems but have them at a 

different level* 

4* If this problem is to be solved, X would certainly xrather rely 
on the quality and abilities of our staff to solve it. 

Attachsaent II indicates at least one thought I have held on directions 
for future experimentation* I the letter Is not clear to the 

extent that "participate with us In planning” 2 aasan a feasibility 
study and possible implementation 

I anticipate 'that there may be sam differences of opinion and some 
disagreement with the proposal. Bo far I haven *^t been able to think 
of any data or ol^er evidence which would make the implementation 
of this recosifiriendatton detrimental to the ifiterests of the students 
or the faculty. I hope that you will give t^iis some critical thou^t, 
and if possible, present your ideas to me in writing so that we can 
distribute them to the staff for consideration prior to the meeting* 



HMsca 



At tachmen'^' T ^ 



o p y 



1'0"i Br-. Ma,:s 'See Dr. Harless; 
H'roir ficnZ): Ma as S l€J Id s 1 r -. 



Inter-01' t' ice MemorandiiiT 
EL CmjMO COX^LEGF* 



Sub j act ?: 



Xr.ter“rH,str;^.ct Cocralnati fcr Dates 
Television Presentation c-:: 

Msthematica A Cr’JIeiiientary Algebra) 



October 28, 



1965 



1 re?coMiiend. that- 
witn \iB in nlanniig 
krax I4at nematics A| 



tbe X;OS ^i.nge.,ies ji\siaxoi co*i.]Lege»3 to ^axrticx^ave 
for tele via S,.on >>r3Beiit«ition c-f Elenientary Algebra 



Tne attached repoct indicates soiae advances in TJ presentation by_3Lcs 
i'.iigeles Coiinty anS X««or'- Angeles City nslng C&i^.xiiiel 28.-. 1 believe that 

C'ha.n? 3 el 28 is the proper facility for the prcgrasr.., and the coverage 
could be augaeated by ' c las .-ad circuir vi.deo-tape presentations on sc-sveral 
of the campuses. 



For procedure 1 v- 3 uld suggests 

111 Form a coji^iaittee of repres^er.tafcivea -Cin Hsthematics) from ea.c'h 

of ti<e Loi? Aagdl.e&i Jii\rj.ior cc lieges and B3. Casi.?.no Co3,lege to a.alce 
a'^feEvsibrllty' g’trdy.., deterfi'ius the course conl:e-At,; and develop 
lr.,s t:i tu't.loial and aval ?:iat;ior methcdt;; and procedures o 

i'2'i Xnforn all of t’ha other juxiiar colleges, and ra some cases , 

scr»aKi£te iadui'fc educcition bcIooj-b i.n JjOS dfccjelc^s and Cxcxnge Councy 
cf orr detailed plans zjic tnesn 'cc rart:- c.^patSc 

the large no.,;iifeer of students iavol\^ed and orr eKpe^rience large 

classes usin'i pro j.T3CE\u@;d material, ; i beii.eve mat th.i.s approach Is both 
eduou-cicna.lly and economically feas.-llle,- Althotsgh I believe that our 
orJcj.criaX plrsnning should be limited to this one course, the area of ^ 
college aritiimetiCj including minimim graduation and mathematical litex'acy 
reouly.’eiY'.cnts , war .rants future cor;s^(.l0rat,ioiSf. In other tlelds^ X ber leve 
that courses whi-c'i arti b. 3 slcally reisedisl in nature and involve large 
nuHibora of s'ciAclents v,??.iXT 5 Tant. S'3 .t.1ous conBldera'cloii. for raxge scale presen."* 
ta ti on . 
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Other Techniques to the Analysis of Factors Relating to 
the Instructional Process « 



XZ, 



t 

KE 



er|c 



statement of the Problem 



tfhile the figures may very somewhat for different courses 
and for different institutions, it is generally true that of 
the total number of students who initially enroll ^ 
limior college mathematics course, approximately 50% will 
withdraw prior to the penalty date (usually 4-6 weeks) and 
of those who remain approximately 50% will pass wll* a C or 
better grade. Xn other words, success 1s achieved by only 
25% of the students in a course. Xt is believed that students 
in any course should have at least a 50% (and hopefully a 
hicfher) chance of success, and while the process of education 
is not necessarily an efficient process, the use of instructor 
time at 25% efficiency is wasteful and expensive. 



^ Xn particular we need to (1) study the measurements of 
success, (2) find something to predict success, and (3) system- 
atlcallv study all facets of the problem of student success 
and failure. In addition studies of individual factors and 
their predictions of success have been limited in application 
and capsd>le of little generalisation. A systems 
a particular area of instruction may provide some insights 

into the problem. 



The problem of student success in courses is of concern to 
all schools and in all courses. The degree to 
results of this experiment can be ^ ^ 

other schools and courses, de^nds cm ^e v^iabiea 

relationships and the degree to whicih ^ 

are influenced by local factors. In addition, if any 
are obtained within the framework ^pf this problem, the laethods 
may be applicable whether or not the results are. 



The problem may be stated concisely in the f at low i n g hypoth- 
esis. 



n 



Hypothesis 

There exists a relation y ^ ^i^i^^i^ 



i«l 



where (a 

Cb) 



n are constants and at least one is not aero, 
the * x^ are student or course characteristics. 



aad (c) y is the student “s grade. 
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III* 



Assusaptlons 

Since the real concerns are the percent of students who 
successfully ccsaplete a course and the efficient use of Inst^c* 
tor tliriQ, the priiaary ass\M!^tton is that ^e 
the hypetheeia will provide a means 

Other assujsptioas vhidii seam aj^ropriate for this study are. 



fl) Unreason^le restraints or artificial or capricious 
barriers should not iis^ede a student °s progress 
toward his goal. 



(2) BJiperitasntation in education should 

the effects C®» students) of failure will be ssinimal. 



C3) 



The student is entitled to reasonable standards 

to the sais® chance of success regardless of the section 

of the class in which he happens to enroll. 



(4) Reasonable criteria laaay be used to restrict entry into 
a course, 

1 5) ^Ihe grading standards must be realistic in terms of 
the objectives of the course, and 



(6) A quality pregram must be maintained* 



IV* Related Research 

^Thile tl^c^re are many studies relating to a single or a few 
predictor£ of student success, a brief search has not uncovered 
any broad studies of the type attempted in this 
study progresses , further review of related ^ 

made to compare the correlatloriS of sem^ ol* the single factors. 



Vo 



Procedure 

For a problem of this type, which is basically multiple 
2 urvilinear regression and factor analysis, the sau^le needs 
to be as large as possiJale- 1h© initial effects will 
3ata on students in three different courses wnich enroll 1500# 
LOGO, and 500 students each semester* Bata on all math^atics 
courses and all students in mathematics courses is available 
irora 1960 to the present. 



TtkO steps that will be follcjwed ares 

(1) Select Variables and Criteria 

!Z!he information available is (a) High School and High 
School grade point average, ih} grades ^ previous 
El Camino College mathematics courses, ic| scores on 
Ms.thematics Placement Test, Cd) SCAT -* Q, ^ 

Scores, <e) English Placement Test score, (f| age, 

(g) marital status, Ch) sex, (i) veteran °s status. 



1 



Henry Mansfield, Jr. 

SI Camlno College, Calif « 

Eese 2 urcih Proposal 

y) fell time or part, time student, (k) the student ®s 
major, CD the teacher in the course. Cm) the distri- 
bution of grades in the course, anci (n) the hour of 
the day (or night) at ^hich the course uas offered. 

Additional information on students may be easily 
obtained and processed through the IBM 1230 optical 
scanner and its card output. Information on the 
success of students who transfer to a state college 
or branch of tlio University of California is routinely 
available and could be used with some effort. 

(2) Code in IBM cards 

This has been done for most of the data. 



it 
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((3) 



Ccinputer Riin 

(a) correlation matri 

(b) distribution data 

(c) scatter plots 



Coscputer Run 



For all reasonable predictors, get a step-wise 
regression with a listing of the p -weights for each 
varii^ie for each correlation. 



(5) Cross - Validation and analysis of residuals, 



Whi'*'^ the procedure and analysis described here is In a ^ 
brief form, there are decisions involved at eac^ stage of the 
prctcess which will determine the direction of further inves- 
tigations. Willie this could be included by statements cover- 
ing all possible directions taken after all possible decisions. 
It is not Included in this brief outline. 
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